Implement email and web page outputs. 🔼

Lua can send email directly using LuaSocket, which I'm already using.

The web page should include links to the detailed reports and the logs.

Evilham has a TODO to sign the email for the mirrors list.

reported=2019-06-25 03:11:19

reporter=onefang

priority=low

category=TODO

severity=block

resolution=fixed

2019-06-25 03:28:26 onefang: An email looks like this (this is an old one, picked coz it had failures) -

Dear Mirror Admins,

The full list of Devuan package mirrors is available at the URL:

https://pkgmaster.devuan.org/mirror_list.txt

Please contact "mirrors@devuan.org" if any of the information

in the file above needs to be amended.

Please see below the current status of the Devuan Package Mirror

network:

---- BEGIN MIRROR-STATUS ----

pkgmaster. devuan.org....

  http: [OK] https: [OK] DNS-RR: [OK] Updated: [SKIP] Integrity: [OK]

sledjhamr. org/devuan....

  http: [OK] https: [OK] DNS-RR: [OK] Updated: [SKIP] Integrity: [OK]

mirror. 4isp.it....

  http: [FAILED] (4 errors) https: [FAILED] (4 errors) DNS-RR: [OK] Updated: [SKIP] Integrity: [OK]

mirror. koddos.net/devuan/devuan....

  http: [OK] https: [OK] DNS-RR: [OK] Updated: [SKIP] Integrity: [OK]

devuan. dcc.uchile.cl....

  http: [OK] https: [OK] DNS-RR: [OK] Updated: [SKIP] Integrity: [OK]

devuan. mine.nu....

  http: [OK] https: [OK] DNS-RR: [OK] Updated: [SKIP] Integrity: [OK]

mirror. vpgrp.io/devuan....

  http: [OK] https: [OK] DNS-RR: [OK] Updated: [SKIP] Integrity: [OK]

ftp. fau.de/devuan....

  http: [OK] https: [OK] DNS-RR: [OK] Updated: [SKIP] Integrity: [OK]

mirror. ungleich.ch/mirror/packages/devuan/....

  http: [OK] https: [OK] DNS-RR: [OK] Updated: [SKIP] Integrity: [OK]

devuan. ipacct.com/devuan....

  http: [OK] https: [OK] DNS-RR: [OK] Updated: [SKIP] Integrity: [OK]

dist-mirror.fem.tu-ilmenau.de/devuan....

  http: [OK] https: [OK] DNS-RR: [OK] Updated: [SKIP] Integrity: [OK]

devuan. packet-gain.de....

  http: [OK] https: [OK] DNS-RR: [OK] Updated: [SKIP] Integrity: [OK]

devuan. c3sl.ufpr.br....

  http: [OK] https: [OK] DNS-RR: [OK] Updated: [SKIP] Integrity: [OK]

mirror. checkdomain.de/devuan....

  http: [OK] https: [OK] DNS-RR: [OK] Updated: [SKIP] Integrity: [OK]

mirrors. dotsrc.org/devuan....

  http: [OK] https: [OK] DNS-RR: [FAILED] (3 errors) Updated: [SKIP] Integrity: [SKIP]

devuan. bio.lmu.de....

  http: [OK] https: [FAILED] (4 errors) DNS-RR: [OK] Updated: [SKIP] Integrity: [OK]

== faulty mirrors: ==

mirror. 4isp.it (http)

mirror. 4isp.it (https)

mirrors. dotsrc.org (DNS-RR)

devuan. bio.lmu.de (https)

---- END MIRROR-STATUS ----

Thanks for your precious help in ensuring that Devuan GNU+Linux

remains a universal, stable, dependable, free operating system.

Love

The Dev1Devs

devuan-mirrors mailing list

devuan-mirrors@lists.dyne.org

https://mailinglists.dyne.org/cgi-bin/mailman/listinfo/devuan-mirrors

2019-06-25 03:32:36 onefang: The current web page looks like this (the OKs are in green, there are no current failures, so I can't show that) -

Check date: Tue Jun 25 03:51:03 BST 2019

5.196.38.18.... DNS-RR: [OK] Integrity: [OK] Protocol: [OK] URL-sanity: [OK] Updated: OK

31.220.0.151.... DNS-RR: [OK] Integrity: [OK] Protocol: [OK] URL-sanity: [OK] Updated: OK

37.187.111.86.... DNS-RR: [OK] Integrity: [OK] Protocol: [OK] URL-sanity: [OK] Updated: OK

37.220.36.58.... DNS-RR: [OK] Integrity: [OK] Protocol: [OK] URL-sanity: [OK] Updated: OK

46.4.50.2.... DNS-RR: [OK] Integrity: [OK] Protocol: [OK] URL-sanity: [OK] Updated: OK

95.216.15.86.... DNS-RR: [OK] Integrity: [OK] Protocol: [OK] URL-sanity: [OK] Updated: OK

130.225.254.116.... DNS-RR: [OK] Integrity: [OK] Protocol: [OK] URL-sanity: [OK] Updated: OK

131.188.12.211.... DNS-RR: [OK] Integrity: [OK] Protocol: [OK] URL-sanity: [OK] Updated: OK

141.84.43.19.... DNS-RR: [OK] Integrity: [OK] Protocol: [OK] URL-sanity: [OK] Updated: OK

185.203.114.135.... DNS-RR: [OK] Integrity: [OK] Protocol: [OK] URL-sanity: [OK] Updated: OK

200.236.31.1.... DNS-RR: [OK] Integrity: [OK] Protocol: [OK] URL-sanity: [OK] Updated: OK

== faulty mirrors: ==

[OK] No faulty mirrors

Last Failure: Mon Jun 24 11:57:29 BST 2019

31.220.0.151 (DNS-RR)

46.4.50.2 (DNS-RR)

2019-06-25 06:01:36 onefang: Might also be useful to send emails to mirror admins if their mirror fails a test.

Also, should only send emails if told to, maybe check if it's one of the Devuan mirror herders running it, somehow.  Or maybe just play it safe ,output the emails as text, let them manually send emails.

2019-06-26 01:00:34 onefang: Have a bunch of mirror-check-output-*.lua scripts.  They should parse the log files to produce output files.

The main full tests automatically calls mirror-check-output-mail.lua and mirror-check-output-web.lua after the dust settles.

An option of --out=foo calls mirror-check-output-foo.lua after the dust settles.

2019-09-10 05:37:26 onefang: I should include things like -

"https: [N/A]", which will mean the mirror list says it's not supported.  Maybe I could test HTTPS anyway, then report "https: [OK, fix list]" or some such.

2019-11-05 06:32:48 onefang: This is the current web status page, complete with errors (FAILED is red, SKIP is yellow)-

Check date: Tue Nov 5 05:51:01 GMT 2019

5.196.38.18.... DNS-RR: [FAILED] (1 errors) Integrity: [SKIP] Protocol: [SKIP] URL-sanity: Updated: [SKIP]

37.187.111.86.... DNS-RR: [FAILED] (2 errors) Integrity: [SKIP] Protocol: [SKIP] URL-sanity: Updated: [SKIP]

37.220.36.58.... DNS-RR: [FAILED] (2 errors) Integrity: [SKIP] Protocol: [SKIP] URL-sanity: Updated: [SKIP]

46.4.50.2.... DNS-RR: [FAILED] (2 errors) Integrity: [SKIP] Protocol: [SKIP] URL-sanity: Updated: [SKIP]

95.216.15.86.... DNS-RR: [FAILED] (2 errors) Integrity: [SKIP] Protocol: [SKIP] URL-sanity: Updated: [SKIP]

130.225.254.116.... DNS-RR: [FAILED] (2 errors) Integrity: [SKIP] Protocol: [SKIP] URL-sanity: Updated: [SKIP]

131.188.12.211.... DNS-RR: [FAILED] (2 errors) Integrity: [SKIP] Protocol: [SKIP] URL-sanity: Updated: [SKIP]

141.84.43.19.... DNS-RR: [FAILED] (2 errors) Integrity: [SKIP] Protocol: [SKIP] URL-sanity: Updated: [SKIP]

190.64.49.124.... DNS-RR: [FAILED] (2 errors) Integrity: [SKIP] Protocol: [SKIP] URL-sanity: Updated: [SKIP]

200.236.31.1.... DNS-RR: [FAILED] (2 errors) Integrity: [SKIP] Protocol: [SKIP] URL-sanity: Updated: [SKIP]

== faulty mirrors: ==

5.196.38.18 (DNS-RR)

37.187.111.86 (DNS-RR)

37.220.36.58 (DNS-RR)

46.4.50.2 (DNS-RR)

95.216.15.86 (DNS-RR)

130.225.254.116 (DNS-RR)

131.188.12.211 (DNS-RR)

141.84.43.19 (DNS-RR)

190.64.49.124 (DNS-RR)

200.236.31.1 (DNS-RR)

Last Failure: Tue Nov 5 04:51:13 GMT 2019

5.196.38.18 (DNS-RR)

37.187.111.86 (DNS-RR)

37.220.36.58 (DNS-RR)

46.4.50.2 (DNS-RR)

95.216.15.86 (DNS-RR)

130.225.254.116 (DNS-RR)

131.188.12.211 (DNS-RR)

141.84.43.19 (DNS-RR)

190.64.49.124 (DNS-RR)

200.236.31.1 (DNS-RR)

2019-11-05 15:46:03 onefang: The email report is done.

2019-11-06 06:34:54 onefang: The web report is done.